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ABSTRACT 

A study followed three textbook adoption committees 
as they ^yrtluated basal reading programs. The committees used "A 
Guide to Selecting Basal Reading Pror^ ams" (dev^eloped at the Center 
for the. Study of Reading) to help them evaluate the quality of 
Instruction in existing programs • Case studies of the three 
committees sought to address, the following issues: (1) whether the 
Guide was helpful; (b) whether it helped committee members focus on 
the .instructional content; ^(c) whether it influenced teachers in 
becoming* more critical consumers of basal materials; and (d) whether 
there were factors which contributed to the use of the Guide. All 
committee members were asked to read the booklets in the Guide and 
were observed as they used the Guide to evaluate programs. Members 
were asked to fill out questionnaires^ to find out :whether the Guide 
was of help and to determine whether it helped them focus on the 
instructional quality of the basal reading programs. Structured 
interviews followed classroom observations to determine if teachers 
had changed their thinking or teaching behaviors. Results showed that 
80% of the committee members felt that the Guide was helpful. 
Research indicated that use of the Guide improved the selection 
process by giving members information about current reading research, 
by providing specific criteria for evaluating basals, and by giving 
committee members a common framework in which to understand what they 
were evaluating. The extent to -which the booklets helped teachers 
become more critical consumers depended upon each individual 
teacher's level of prior knpwledge and training. Four factors appear 
to have contributed to the Guide's successful use: time, -enthusiasm 
of committee members, in-service ,training, and leadership. (Three 
tables of data are included, and 27 references are attached.) (MG) 
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Abstract 

Although basal reading programs are widely used in American schools, research focusing on how these 
programs are selected by textbook adoption committees is both recent and scant. This study followed 
three textbook adoption coinmittees as they evaluated basal reading prograihs. The committees used 
A Guide to Selecting Basal Reading Programs.to help them focus on the quality of the instruction in 
the several basal series they examined. Results suggested that adoption committees can be assisted in 
sele^ a basal reading program based on a set of common>criteria for evaluating iiistructionai 
quahty. Textbook committees >yere most successful when they had adequate time and training to 
evaluate basals and when they had appropriate leadership and enthusiasm for their task. 
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IMPROVING THE TEXTBOOK SELECTION PROCESS: 
CASE STUDIES OF THE TEXTBOOK ADOPTION GUIDELINES PROJECT 



Basal reading programs are one of the most ubiquitous aspects of reading instruction in contemporary 
American classrooms. Studies during the last 25 years indicate that teachers use basal reading 
programs as the main source of reading instruction in 95% of elementary classrooms (Austin & 
Morrison, 1963; Jacksoii, 1981). Other studies have revealed that many teachers also use and follow 
closely the teachers'lnanuals that accompany these basal textbooks (DuJffy & Mclntyre, 1982; Durkin, 
1984; Hodges, i980; Shannon, 1983; Woodward, 1986). 

Recently, however, researchers have jdentified a number of problems with basd textbooks and their 
accompanying teachers' manuals and workbooks. Davison (1984), for example, has demonstrated the 
adverse effects of readability formulas on the comprehensibility of basal textbooks. Bruce (1984) and 
Anderson and Armbruster (1984) have identified problems at both the macro- and microstructural 
levels in the narratives and expository articles contained in these texts. Osborn (1984) has identified 
problems with workbook tasks whUe Beck, McKeown, McCaslin, and Burkes (1979) and Durkin (1978- 
79, 1984) have described numerous problems with the directions in teachers' manuals. 

These studies, as well as the research on reading processes during the past decade, indicate the need 
for substantial changes in basal reading programs. Translating this need into reality, however, is a 
.difficult process fraught with contradictions. On the one hand, the publishirs of. most basal programs 
have been reluctant to make research-based improvements because they believe that the impetus for 
such changes must come from the textbook adoption committees which actually purchase these 
materials (Dole, R(^ers, & Osbom, 1987; Squire, 19«5). These publishers contend that major changes 
in basal programs will not be accepted by the teachers who use the programs, an argument which is 
supported by research which ^demonstrates that teachers on ttxtbook adoption committees tend to 
select new programs that are most like their old ones (Powell, 1986). The great irony of this situation, 
as Farr and TuUey (1985) have suggested, is that textbook adoption committees often do not have 
sufiidect background in reading or training in the^evaluation of basal materials to demand the kinds of 
changes consistent with recommendations based on recent research and practice. 

It is with these contradictions in mind that a series of booklets have been developed at the Center for 
the Study of Reading at the University of Illinois to help textbook adoption committees evaluate basal 
te>ctbooks. The booklets, entitled A Guide to Selecting Basa! Reading Prpff^ams, were written to 
upgrade adoption c'^mmittee members' knowledge about recent reading instruction research and to 
help them evaluate inc quality of instruction in existing basal reading programs. The Gw/Vfe'^: purpose 
is two-fold: In the short term, to serve as a tool that teachers can use to evaluate critically the reading 
programs from which they now have to choose and, in the long term, to create more knowledgeable 
educational consumers who will push publishers to produce better reading programs. 

The Guide's effectiven(;ss is the subject of this report about three separate adoption committees. Each 
of these case st^dies.>6ught to address the following issues: (a) whether textbook adoption committee 
members perceived the Guide ds bemg helpfid in the textbook selection process; (b) whether the Guide 
helped committer, members focus on the instructional, content of textbooks; (c) whether the Guide 
influenced teachers in becoming more critical consumers of basal materials; and ,(d) what factors 
contributed to the likelihood that adoption committees would use the Guide and find it helpful. It 
should be noted that while various aspects of the selection process will be discussed arid a general 
description of the procedures each of the three committees followed vwll be given in the following 
pages, a study of the entire selection process itself lies outside the scope and purpose of this study. 
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Background to the Textbook Selection Process 

To understand the need that the Guide fiUs, it iSsUecessary to understand something about the textbook 
selection process itself. Until reccntlyrthe sejectidn process has not been a topic of research. During 
the last decade, however, researchers have^begun to look carefully at the process of how textbobks are 
solecteA In particular, Farr and his associates (Courtland, Fan, Harris, Tarr, & Treece, 1983; Farr & 
TuUey, 1985; Farr, TuUey, & Rayford, 1987; Powell, 1986; Tulley, 1985) have begun to study how 
textbook adoption committees go about selecting one basal reading program from among the 16 
programs that are currently commercially available. 

findings by Farr et aL(1987) and others (Marshall, 1985, 1987) indicate that many factors come mto 
play during the prpcess of selecting basal reading programs. These factors include: the presentations 
made by the publishers' representatives, the leadership on the selection committee, the amount of time 
the committee has to make^a choice, the committee members' training and e;q)ertise»:the amount of 
adminisuative support the committee receives, and community participation in or influence on the 
sclecUon process (Glenn, 1987; Winograd & Osborn, 1985). Because so many factors often enter into 
the decision-making process, the goal of selecting the textbook of the highest instructional quality 
frequently becomes obscured. 

The fact.that instnictiohai quality, frequently lakes a backseat to other considerations may be traced to 
the nature of the tcxtboolc selection process and to the background and experience of people who sit on 
the adoption committees. The selection process often entails a committee's working with a checklist or 
evaluation forms (Powell,^ 1986). Althoi^h these evaluation procedures differ from district to district 
and from state to state, there are many commonalities. Many checklists, for example, include criteria 
for evaluating the physical appearance and utility of basal programs (Gomas, 1983; Courtland et al., 
1983). Comas found that 73.1% of the checklists she sampled included items about illustrations. Many 
checklists also mclude criteria for evaluating the sodal content of textbooks, for example, sexUm, 
racism and stereotyping. Squire (1985), a publisher, listed a host of such specifications which are now 
required by most states for all basal reading programs. 

These checklists, however, frequently lack criteria for evaluating the instructional quality of basal 
programs. In her examination of the textbook selection process in two districts, Powell (1986) 
presented data about how two textbook adoption committees evaluated textbooks. The evaluation 
checklists used by Powell's districts are fairly representative of those used by districts around the 
country. (See Comas, 1983, for a review.) An examination of the checklists reviewed by Powell (1986) 
reveals some of the problems and weaknesses inherent in most such checklists. For example, one of 
the problems Powell identified was the fact that these checklists promoted the widespread use of the 
"flip-test," whereby evaluators thumb quickly throu^ the book looking briefly at the pages. When she 
asked several committee members what they were looking for when they used the "flip-test," they were 
unsure. One said, "I just know I take this book ... and I do this (flips pages), if those pages are too 
busy, I set that down for a while.** Another committee member commented, "I guess (I look) just to see 
if it appeals to me, or you know, if I would be interested in it" (Powell, 1986, p, 328). These and other 
similar comments from the two committees she studied led Powell to conclude that such practices 
encouraged, at best, a superficial review of basal programs. 

Another major problem with the use of these checklists is that they rarely encourage evaluators to 
focus on the instructional quality of the basal textbooks they aire examining. One of the checklists in 
Powell's study, for example, can be completed without ever critically examining the method of 
instruction used to teach comprehension sidlls, phonics or vocabulary. And, even when checklist items 
do focus on reading curriculum or instruction they are often phrased in such a way as to be open to a 
broad, rather than a specific, interpretation. As a result, for instance, the committee members in 
Powell's study interpreted the items on their checklist very diiierently. When asked what they looked 
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for as they evaluated comprehension instruction, they indicated diverse criteria such as "harder 
vocabulary words," "critical comprehension skills," "comprehension questions, activities, and exercises," 
and "lots of practice pages in the workbooR and skills sheets for comprehension . . . context clues." On 
the basis of such comments, Powell (1986) concluded: 

The obvious result of these data is that most of these teachers did not have a good 
understanding of reading cOiflprehension; therefore, it was impossible for them to 
know how to judge the comprehension strand of instruction in a basal program, (p. 



Introduction to the Case Studies 

TheGuide 

The evidence, then, suggests that basal readbg programs are often nof. chosen on the basis of the 
qualityof the instruction in those programs (Farr, fuUey, & Powell, 1987). A Guide to. Selecting Basal 
Reading Programs was developed to help teachers select basal readers upon the basis of current reading 
research and exemplary practice rather than upon the basis of peripheral considerations. (See Dole, 
Rogers, & Osbom, 1987, for a complete description of the.G«/d^.) The Gu/^fei developers wanted it 
to: (a) help adoption committees understand the issues involved in effective reading instruction; (b) 
delineate what committees should look for when evaluating the content and instructional quality of 
basal reading programs; and (c) provide a procedure that would help committees both to analyze 
effectively the content of programs and to record their findbgs. They also hoped that the Guide would 
provide adoption committees with the knowledge base they needed to make a case to publishers for 
improved reading programs. 

A Guide to Selecting Basal Reading Programs consists of several booklets and a Leader's Manual. Each 
booklet discusses a specific topic important to reiiing^instruction. Three booklets had been developed 
when the Giiide was used in the three case study districts. These booklets were on the topics of 
vocabulary, workbooks, and comprehension instruction. The vocabulary booklet was developed first 
and served as a prototype for the rest -of the booklets. This booklet will be described in detail to 
illustrate the organization and content of all of the booklets. Ekch booklet contains three sections: 
Research and Practice, Guidelines, and Evaluation Prcc dures. 

In the Research and Practice section of the vocabulary booklet, textbook evaluators are provided with 
summaries of current research about vocabulary ac^iiion and instruction. Three major approaches 
to the teaching of vocabulary m basal reading programs ait then described and evaluated. How each 
approach can lead^^to different. levels of wc.d knowledge.and affect comprehension is discussed and 
examples of more and less effective instruction are provided. 

As each approach is explained, a guideline is presented. For example, the guideline about what to look 
for when evaluating the contextual approach follows a discussion of that approach: 

When a basal program uses a contextual approach, look for: 

• instructional contexts in which sentences provide enou^ context clues 
for students to accurately figure out the meanings of words. 

Following the research and practice section is a list of all the guidelines that appear in that section. 

The evaluation procedures follow the guidelines and suggest how evaluators can determine Sow well 
the guidelines are met, in a program. The vocabulary worksheet provides space for. comments on the 
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vocabulary activities m a particular lesson. Evaluators analyze which approaches to vocabulary the 
program uses and for each approach make a judgment about the quality of the instruction. For 
example: 

When a program uses a contextual approach, evaluators must ask, "Do the sentences 
provide enough context clues for students to figure out the meanings of words?" 

Methods 

The Three Sites 

The three adoption committees we studied were not selected randomly. AU three committees shared a 
number of characteristics. First, these committees were located in districts in "non-adoption" states, 
that is, m states that did not require districts to choose from a state-approved list of recommended 
basal programs. Second, these districts were not representative of the full range of geographic or 
demographic distribution of districts in the country. Third, these districts could be described as well- 
.motiv^ted^d^ in the sense that they sought technical advice from the Center for the Study of 
-Reading to help them m their selection of a basal reading program. 

Site A. The first textbook adoption site studied was located in a suburb of a major city in the Midwest. 
The adoption committee consisted of one teacher from each of the seven schools in the district and was 
lead by the district's reading coordinator. The corkimittee used the booklets over a period of 9 months, 
beginning in May and ending m February when it made a final dicision on the basal program to be 
adopted. 

The committee at this site used its own procedures to screen basal programs and reduce an initial list 
of eight programs to three programs. This task was accomplished before the Guide was used. 

To use the Guide, the committee, divided itself mto three groups. Members of each group read one 
booklet (either the vocabulary, workbook or comprehension booklet). The group then met with Center 
staff who demonstrated how to use the worksheets to evaluate the three programs they were 
considering. Each group worked on the worksheets and Center staff members observed them and took 
field notes. 

During this initial training session^ committee members were able to evaluate two basal programs at 
one grade level. They evaluated the rest of the materials in their own homes and together in their 
committees. When the groups completed their work, the committee met as a whole. Each group 
presented an oral report summarizing how the different topics were handled in each of the three 
programs. The entire committee then rated and ranked each program on each of the three topics. 

Site B. The second textbook adoption site was located in a Western town about 1-1/2 hours away from 
a major dty. This school district looked upon the textbook adoption process as part of a larger effort 
to change and improve reading instruction. The district had embarked upon a year-long staff 
development program that was coordinated with the chcosing of a new basal re aduig program. A 
group of 50 district personnel (including a principal and a teacher from each school in the district), 
participated in these coordinated programs. The group was led by the district's curriculum 
coordinator. The district began its staff development program in June, and worked through the next 
academic year before making a final selection of a basal program in April. 

This adoption committee began the textbook selection process with a week-long in-servdee training 
prograjn designed to provide committee members with new information about reading instruction. 
Center staff members provided the in-servdce training to this group using information from the Guide. 
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All committee members read the vocabulary, workbook and comprehension booklets as part of their 
m-service training. 

In the fall, 7 of the 50 principals and teachers were chosen to be team leaders whose task was to train 
the rest of the committee. Center staff trained this smaller group in the use of the booklets, and 
observed them as they evaluated two basal programs. The smaUer group then led the rest of the 
committee members, through the evaluation process la a series of meetmgs held over a period of 
several months. The larger committee broke bto small groups, with each group evaluating workbboks 
and vocabulary and comprehension instniction^m several basal reading programs. Group members 
ratod each topic m each program, and then the committee met as a whole to discuss their evaluations. 
Basal programs were elimmated one at a time, until a final decision was made. 

Site C. Adoption committee C was located in a small Midwestern town. This committee used the 
Gii/de during an academic semester, beginning in October and endmg m January of the next year. The 
committee was led by a district curriculum coordinator. 

This particular committee hiad worked with the Center staff the previous academic year, providing us 
with critiques of early drafts of the booklets. When Center staff began working with committee 
members m the faU of the foUowing academic^year, they had narrowed their selection down to four 
basal programs. They decided to have selected committee members pUot these programs m their 
classrooms. At the same time, committee members read the Guide and evaluated the programs they 
were piloting. The committee's leader felt that the combination of pilotmg and use of the Guide would 
provide detailed information about the strengths and vyeaknesses of the programs they were evaluatmg. 

This particular committee was not trained by Center staff in how to use the Guide. Staff members met 
with the committee en three different occasions. Each time one booklet was given to committee 
mec.bers. They were asked to read each booklet and then complete the worksheets on each of the two 
programs they were pUoting in their classrooms, AU of this work was completed mdependently by 
committee members. Monthly meetmgs were held and comihittee members met/by grade levels to 
compare notes and to come up with evaluations and ratmgs of each topic for each program based on 
the worksheets and on the pUoting. In January, aU of the evaluations were presented, and a decision 
was made to purchase two alternative basal programs. 

Data Collection Procedures 

Despite our attempt to use the same data collection procedures at . each of the three sites, on-site data 
coUection varied from slie to site because of the different procedures foUowed by the local adoption 
committees themselves. Data coUection proceeded as follows. First, aU committee members were 
asked to read the booklets. The Center staff then trained members at Sites A and B (at their request) 
to use the evaluation worksheets. The staff next observed committee members at Sites A and B as they 
used the Guide to evaluate programs. Field notes were taken of these meetings'. 

Next, staff gave questionnaires to committee members at aU three sites. The purpose of these 
questionnaires was two-fold: to find out whether the three committees felt the Guide was of help in the 
textbook selection process, and to determme whether the Guide helped them focus on the instructional 
qujiiity of basal reading programs. Once the questionnaires were completed. Center staff conducted 
follow-up interviews with committee leaders to provide additional corroboration of questionnaire 
results. 



Committee leaders then selected two or three committee members whom researchers contacted for 
additional data coUection. A member of the Center staff observed each committee member in his or 
her classroom for a reading period. FoUowing these observations, structured interviews were 
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conductwi with each of these committee members. These interviews were designed to corroborate 
data gathered from the questionnaires and to determine if committee members had chanecd their 
thmklng or teaching behaviors over the short term. 

Results and Discussion 

The results of these questionnaires, observations, and interviews are discussed as they relate to the 
issues raised at the begmning of this paper. 

To answer Als question we analyzed the questionnaires given to the members of each adoption 
Mmmittce after they had used the booklets to evaluate the textbooks they were considering for use in 
their districts. Nmety-four percent of committee members responded to the questionnaire. The 
individual mtervicws (conducted with selected members of each committee and with the leaders of aU 
three committees) provided additional information. 

The results of the questionnaire responses of aU three committees are presented in Table 1 These 
data show that 80% of the committee members felt that the Guide was of use in helping to choose a 
basa^ rea^g prpgram. Table 2 presents more detaUed data about why committee members felt the 
way they did. Ahnost two-thirds of those who would recommend use of the Guide to others indicated 
that the Gmde s use made th? evaluation and selection of a basal reading program a more educated. 
systemaUc and critical process. «uv«icu, 

[Insert Tables 1 and 2 about here.] 

The foUow-up interviews with committee members corroborated these findings. One committee leader 
commented. 

What they [the committee membcrsj got out of it was that in the end they could 
evaluate basaU thoroughly. They knew them inside out when they were done. They 
did an objective job-they quantified and they felt they could justify their decisions. 

Another leader noted, 

[The Gjtide] made a uniform judgment about different areas. One that we could even 
quantify with a niimbcr rating. ... It gave, I think .. . more vaUdity to the study and 
the number system gave us information that we didn't have before ... and it made 
more sense and it was more objective. 

Additional evidence corroboratmg this finding U presented in Table 3. Twelve individual comments 
^Tthoro^i approach taken in the booklets made the evaluation process objective, systematic 

Table 3 provides other information about why committee members felt positively about using the 
omae. Committee members often remarked that the Guide provided committees with research-based 
l^in°^cw '«ading instruction, a finding corroborated by one committee leader during a foUow- 

What I found, as exciting as you can get in curriculum I suppose, was that the 
(teachers') judgments refiected the background of information that the Guide 
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provided. They were made in terms of that background information. I think that it 
raised to a higher level the dkcussion about what was important in our reading 
selections. 

[Insert Tabiz 3 about here.] 

One-third of the committee members, however, gave only a qualified "yes" to their positive 
recommendation for use of the Guide. These respondents focused on some of the factors which they 
perceived as limiting the Guide's effective use. More spedficaUy, they noted that committees using :he 
Guide needed appropnate in-service training, interested and enthusiastic committee members, and 
adequate tune in which to use the Guide as an evaluative tool. 

These questionnaire responses were also corroborated by the foUow-up interviews with individual 
committee members. AU three individual committee members' interviewed from Site A, for example, 
commented that they learned as much about reading instruction from in-service training and graduate 
dasses as they did from the Guide itself. They also felt that it was this combined knowledge (rather 
than the Guide alone) that enabled them to be knowledgeable enou^ to evaluate basal programs. 
One committee member a<so commented that much had to occur in a district before the Guide could 
oe used, an observation echoed by a committee leaden "The background needs to be there. Then they 
needed some expert (a reading person) to explain things to them and to walk around and help them." 
0?her committee members expressed similar sentiments. One said that districts not only needed a 
highly trained and mterested group" evaluating the materials, but also needed "to keep other teachers 
informed and in-serviced." Another committee member felt that a precondition for a district's 
successful use of the Guide had to be a clear sense of what was most important to the district when it 
evaluated and selected a basal reading program. 

Twelve percent of those committee members responding to the questionnaire would nol recommend 
use of the booklets to other adoption committees. Their major criacism was that the guidelines in the 
booklets did not discriminate aidong basaU. One committee member argued, "If the basals are similar, 
there s no way to make a decision." 

These results suggest, overall, that committee members perceived the Guide as being useful in helping 
them choose a basd program. Committees pointed specifically to the objectivity and systematic 
analysis of basals.jHat the Guide affords. Committee members did, hovicver, have reservations about 
patently recommending the use of the Guide to other basal adoption committees. These reservations 
cente.ed around the perception that using the Guide was a time-consuming process and the belief that 
committces.would have to be committed and well-trained in order to use the bookleU. 

2. Did the Booklets Help Committee Members Focus on the Instructional Content 
and Quality of the Basal Textbooks They Evaluated? 

Research indicates that most selection committees do not have adequate background knowledge about 
readmg and do not know how to evaluate the instructional quality of basal programs. Data collected 
during the Guidelines Project indicated that a properly designed worksheet helped some committees 
^transcend these shortcomings. Committee members at all three study sites completed lengthy 
worksheeu in which they evaluated detaUeJ aspects of instruction as identified by the guidelines in 
each booklet. Their subsequent commenU indicated that.they were beginning to apply the knowledge 
acquired from the Guide's booklets to very specific instructional features of the basal programs they 
were ev^uating. Their written evaluation reports, for example, included critical comments, supported 
by specific examples, about vocabulary/ instruction and the value of prereadmg activities and the 
importance of relating the concepts in stories to children's experiences. 
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For example, comments from written evaluation reports included: 

'prereading activities relate concepts in the story to children's experiences" 

"suggestions for discussion preceding the story reading relate the concepts in the stot^ 
to the children's experiences" 

The prcreading background is great" 

"gives good background knowledge" 

"asks questions that build on background knowledge" 

"purpose-setting, silent reading, chiecking and developing comprehension after each 
page ... this breaks up the story too much: difficult to grasp important overall 
concepts" 

Cbmmittec members used their new knowledge not just to make very specific comments, about the 
quality of instruction they found in the programs ihey were considec'ng. Interview data indicated that 
committee members agreed upon the evaluation criteria they were usmg and that they were identifymg 
the same things. Fof cxanj>lc one committee's (^rvation that the ques:Jons in a basal program were 
. . wide open, too general . . . there's a whole barrage of questions t i ask and uo directions for 
teachers" was seconded by another committee that noted: "There are too many questions overall. In 
the student reader there were questions, but these were not in the right order and arc not relevant to 
the story." One group evaluating vocabulary instruction in one program reported: 

This text uses a conceptual approach, but it-is not labeled. The text is dependent 
upon the teacher. I would like to see more in the manual for those teachers who 
don't know it. What will be taught is what is in Ihe manual. 

(For example) . . ."Plant. One second-grade story is about a plant (a factory) . , . plant 
is later discussed briefly in comprehension, but not directly. Children are not 
mtroduced to the concept of a plant as a factory, though that's what the story is 
about." 

While the members of ail three selection committees used the Guide to focus on the instructional 
quality of the basals they examined, the data also mdicated that at least some committee members 
integrated their own beliefs with the booklet criteria for evaluating textbooks. At Site C, for example, 
committee members commented extensively about levels of questions in the comprehension strand] 
although levels of questions were not part of the criteria listed on the booklet guidelines. Repcp»-!d 
comments reflected their contmumg concerns: 

"the level of questionbg is good" 

"mclude a good balance of literal and inferential ouestions" 

"most questions ask children to recall details of the story" 

"questions following story reading are often inferential, not just literal" 

"most of the questions are very helpful and are both literal and inferential* 
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In sum, evidence from the Guidelines Project md|icated that the use of a properly designed tool such as 
the Guide improved the selection process for these committees in several ways. First, by giving 
committee members important background information aix)ut current reading research, the Guide 
deepened committee members' awareness of the problems with many basal reading programs and how 
tbey might compensate for these deficiencies in the classroom. iSecond, the Guide helped committees 
focus on the instructional quality of the programs being considered by providing specific criteria for 
evaluating basals. Lastly, by providing a structure for organizing their evaluation, the Guide gave 
committee members a common framework within which to talk about and understand what they were 
evaluating. At the same time, however, it is important to note that there was evidence to suggest that 
even when a tool like the Guide was available, committee members did not necessarily completely 
abandon their own evaluative criteria. The extent to which and the reasons why committee members 
mtegrated their own criteria with the new criteria is an interesting question, and one that certainly 
warrants further study. ^ 

3. Will Use of the Booklets Help teachers Become More Critical Consumers of 
Basal Materials? 

Although we did not have base-line data about how committee members used basal textbooks before 
they participated in the selection process, we discussed this topic with selected members of each 
committee after they had evaluated basal programs. We talked to them about their use of basals in the 
past, and if and how their thinking and teaching behaviors bad changed as a result of the knowledge 
they had gained from evaluating basal textbooks usmgA Guide to Selecting Basal Reading Pro-ams. 

Responses to these qucstions'varied from district to district. District B-reported the most specific 
changes in thinking and behavior. For example, all four committee members interviewed said they had 
used the comprehension section of the teacher's manual differently than they had the previous year. 
Several committee, members reported they had started to use story maps. The class caught on 
immediately," reported one second grade teacher. Three members of the committee reported asking 
different questions in class because they now paid more attention to sequence and understanding 
rather than keying in on details. Two committee members also reported using workbooks more 
selectively. T pick out >^hat I want to use more now than I did before," said one committee member, 
while another reported, "Now I don't use all Jhe workbook pages. I slcip lots more pages this year. I 
did sometimes before, but I felt guilty. Now I don't. Now I know it's okay to pick and choose 
workbook pages.- 

Responses from teachers at Site A corroborated these general findings. Two of the three committee 
members said that they were more critical consumers of basal materials. (The other teacher reported 
that she never used the teacher's manual, either before or after reading the booklets.) One teacher 
reported that she looked more carefully at the background building section and the purpose-setting 
sections of the directed reading lesson "rather than taking them point blank." She also said that .she 
now goes over the storyline after students completed reading a ^selection. Another teacher said her 
readings over the last 2 years have caused her to teach comprehension differently. She now asks 
students what they know about a topic of .^ text, writes down what students say, and then extracts 
questions from these responses. It is important to note, however, that all three of these teachers had 
classes and/or workshops in reading before they read the booklets. All three reported that they were 
ah-eady "familiar" with some of the ideas in the booklets. They also had a reading coordinator who led 
them through the process, and had given them readings on current research in. reading before the 
adoption process began. 

Overall, the three teachers interviewed at Site C aU reported fewer changes in their thinking or 
behavior. One teacher said that the Guide was "good for those who don't have the background," but 
that she ah-cady knew the information presented in the Guide: "I have a degree in reading, so I have 
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always been critical about these things/ A second teacher interviewed also reported having heard a lot 
of the Guldens information before. The third teacher felt that the Guide was of little value to her since 
she taught first grade and was more interested in phonics than in comprehension. 

Before we draw any conclusions from these responses, we have to caution that these teachers probably 
do not represent "average" teachers. They were selected by committee leaders because of their 
willingness to talk to us and let us observe their classrooms. It is therefore likely that these teachers 
represented the "best," and their responses have to be interpreted in that light. Nevertheless, their 
responses are of interest:for the light they shed on several points. First, as previously noted, when 
teachers cited growth in their knowledge about basal reading programs, they did not mention the 
booklets as the only source of their learning. AB of the teachers interviewed identified additional 
sources-from books and articles to graduate classes to in-services. Second, the extent to which the 
booklets helped teachers become more critical consumers depended at least in part upon a teacher's 
level of prior knowledge and training. For example, two sixth-grade teachers from District B reported 
different kinds of changes in their tWnking and behavior after reading the vocabulary booklet. The 
second teacher's greater depth of understanding of the critical issues discussed in the vocabulary 
booklet may be trace<l to the fact that she has a master's degree in reading while her counterpart had 
not bad an opportunity for cpmparable.professional training and growth. 

iv5!*?T^* Factors Contribute to the Ukelihood That Textiiook Adoption Committees 
Will Use the Booklets and Find Them Valuable? 

Evidence from questionnaires, interviews and written reports suggests that committees at Sites A and B 
found the booklets to be valuable in the textbook adoption process. Committee members used the 
booklets, said they were helpful and that they would, recommend them to other textbook adoption 
committees. At Site C, however, committee members' rcspoiiscs were much more mixed and less 
enthusiastic about the booklets' usefiihcss in their adoption process. A number of teachers refused to 
answer the questionnaires and at least one teacher described the Guide as a "failure" because of "poor 
planning, weak leadership, hostile teachers, and a lack of techni<^ assistance" (personal 
communication). 

Four factors appear to have contributed to the Guide's successful use at Sites A and B and its lack of 
success at Site C. 

Time. Committee members at all three sites commented on the enormous amount of time involved in 
usbg the booklets. Cbmmittee members at Site A noted that because of the time factor, the process 
was "not for everyone." The importance of time as a major factor influencing the decisions of adoption 
committees has been noted by others (Farr & TuUey, 1985), Courtland et aL (1983) found that a major 
concern of the adoption committee they studied .was that committee members perceived themselves as 
not havmg enough time to review the materials adequately. A particularly important aspect of-the time 
factor was the presence or absence of release time. Committee members at Sites A and B were pven 
release time to work on their committees. The Site C committee, however, received no release time. 
The committee had to meet with us at 4:00 p.m. after a full day of teaching. Their reluctance to 
partiapate in the evaluation process was compounded by the fact that they were "expected to volunteer" 
for this projea and received no extra pay for their labors. 

Enthusiastic committee members. Committee members at Site A commented upon the need for and 
unportance of an interested, enthusiastic committee to successfully complete the time-consuming 
process of looking closely at basal reading programs. This committee appeared to have that 
enthusiasm. The committee's leader reported that aU of the committee's members had 
"enthusiastically volunteered for this assignment and that, in addition, at least three of the committee's 
members were involved in graduate classes in reading. The committee members at Site B were 
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basically an enthusiastic group as well. Most of the teachers on the committee were characterized by 
their principals as "master teachers." The leaders of the committee^s seven subgroups all demonstrated 
strong leadership abilities and an enthusiasm for the reading in-ser\dces provided by the Center staff. 

The Site C committee, on the other hand, did not appear to be as enthusiastic as the other committees. 
Their lack of interest was evidenced by their arriving late to after-school meetings, their faUure to ask 
questions, their inattentive behavior during meetings, and their failure to coTiplete our questionnaires. 
One teacher characterized these teachers as "hostile" and argued that she did not think the teachers on 
the committee saw a need for change. In addition to the factors which contributed to this lack of 
enthusiasm (in addition to low morale and no release time or extra pay), she noted that some teachers 
felt that the committee would merely recommend the same programs they had been using for more 
than 20 years, while others felt that the committee would turn a deaf ear to what they really wanted. 

In-service training. Committees at Sites A and B had extensive in-service training in reading 
instruction, along with training in the use of the booklets. Individual interviews with members of l)pth 
committees indi<ated that it was their combined knowledge, about reading instruction, rather than 
kno^edge gained from the booklets alone, that contributed to their understanding of the booklets' 
content, to their ability to use the booklets to evaluate basal programs, and to th-t subscquent changes 
in their attitudes and behaviors. 

In contrast the Sitfe C committee had no related in-service training.or readings, and received no 
assistance from Ctntcr staff on how to use the booklets. Cdmmittcc members simply were pven the 
booklets, told to rcad:them, and then to use them to evaluate the programs they were simultaneously 
piloting on an individual basis in their schools. According to one teacher, this absence of internal or 
external training and assistance left committee Liembcrs "vague and unclear^ about how the booklets 
were to be used. 

Uadcrshlp. Another factor which seemed to strongly influence the booklets* perceived usefiUness was 
the kind and quality of the leadership available during Uic textbook adoption process. Committee A 
had a kno^edgcable reading coordinator ^*o took a strong leadership role during the entire adoption 
process. She was not onty decisive in assigning duties and deadlines, but also able to answer questions 
about reading content and clarify instructional i^ues vfhcn necessary. Committee B also had a strong 
leader. Although he was not knowtedgeable abdut readii^ he provided the adoption committee with 
the leadership it needed by making use of the ser\dces of Center staff. Cbmmittee members at both 
Sites A and B felt that this strong leadership contributed to their successful adoption process. 

We have evidence, however, i^ch indicates that the adoption cbmmittee at Site C did not perceive 
their leadership as effective. Committee members pomted out that no administrators served on the 
committee, although principals and other administrators were perceived as having influence on 
curriculum decisions. One committee member commented that there was at least some feeUng that 
the selection of basal readers Had already been decided upon by the administrators. This sense that the 
committee not onfy lacked leadership but also did not exercise much control over the adoption process 
helps to account for its lack of success in using the booklets to help its members select a basal program. 

Summaiy and Conclusions 

Thelindinjs from these three case studies indicate both the Guide's usefWness as a tool to improve the 
teilbook selection process and the factors that can encourage or limit its successful use. On the one 
hand, adoption committee members generally found the Guide to be hclpliil because it provided them 
with specific criteria Vfbich permitted them to focus on the Instructional quality of the programs they, 
were evaluating. The Guide vfas only somewhat helpful, however, in assisting teachers to become more 
critical consumers of basal materials. On the other hand, a number of internal and external factors 
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influeiiced just how successftvcomiailtccs werc in the Guide to evaluate programs. At all three 
sites, for example, the Guide*s success was evident Sfom the fact that it helped committee members to 
focus on evaluating the instructional quality of reading prograins. At Site Q however, several 
considerations, including time, comiaUtee commitment^ in-service training, and leadership limited the 
Guide's SMCCc^^ 

Determining the extent to y/idch these results may be generalized to other textbook adoption 
committees in particular and to the adoption process in general means we must consider how 
representati\'e these committees are of textbook adoption committees aaoss the country. The 
committees w^ worked with were, in many senses, very typical of adoption committees nationwide. 
These committees consisted largely of teachers and comnultce leaders who varied in their levels of 
education, their teaching-abilities, and their willingness to improve their own teaching. Many had 
served on previous. adoption committees. All were very consck>us of how much time they had to 
commit to the selection process. Over 90% of the teachers on these committees regularly used basal 
materials, and many were quite satisfied with the materials they used. And, most were hot aware of the 
"comprehen^n revolution* (Pearson, 19SS) and new research in rdiding. 



While the committees we worked wth were very typical; ihcy were also very atypical in several 
important respects. All^threc had sought assistance from the Center for the Study of Readii^ and 
volunteered to work with:xus. All of these ommuttees werc from non-adoption states and from 
relatiwfy small districts rather than the large, urban districts that account for the vast majority of the 
nation's students. These districts were also distinguished frmn others arouiid the. country by an 
underreprcsentation of minorities among their student bodies and a lack of geographic variability. 

With these ^milarities and dififerences in mind, we thmk we can draw several c>!?dusions about how 
successful the Guide can be in improving the selection process for particular districts. First, the Gmde 
can be of greatest help to enthusiastic adoption committees who lack traimng and expertise in reading, 
but vAo are willing to evaluate basal prograins and receive district support for putting the tune and 
effort into learning Imw to use the Guide. Secondfy, the adoption process can be used very succcssfiilly 
as part of a district's larger in-service training program. In both instances, the variables that will 
determine the Guide's successful or unsuccessful use and the degree to which a district benefits from its 
technical assistance are the same: appropriate release time, adequate support, and committed 
leadership. 

While one major short-term goal of the Guide was to provide technical assistance to adoption 
comnuttees, a longer-term goal was to aeate a more knowiei^ble market of consumers who would 
demand better readmg ograms. At this time we can onfy speculate how successful the Guide will be 
in this regard. As we interviewed committee members after they had used the Guide, we were struck 
by their tendenqr to identify a multipUdty of factors that they beUeved could change their professional 
^ttitudes and behavior. We did not ask for this information; committee members volunteered it. This 
information does suggest that a deep level of processing is required to make the kind of long-term 
changes in teacher thinking that are needed to aeate a more knowledgeable market. 

Intcrestmgly, all three committees mentioned that textbook publishers should read and use the Guide 
as they dcvctop new basal textbooks. Some committee members even felt that the Guide would be 
more i^fiil for publishers than for consumers. It is unclear, howsvcr, to what extent these educational 
consumers would hold publishers accountable for following the guidelines presented in the booklets. 
Publishers will certainly argue that accountability will be necessary before sipiificant changes can be 
made. In the long run, perhaps, what will be required to improve the textbook selection process is 
some com^>fnation of both consumer and publisher action in which each seeks to play "both ends for 
the middle.** 
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Footnote 

^Since members at Site C used the Guidexo evaluate programs at home, it was impossible to 
observe them. However, Center staff were present when the committee members presented their 
findings and have.audiotapes of these meetings and written evaluation reports. 
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1. How useful were the booklets in helpmg you choose a basal reading program? 

Not Useful Very Useful 

i I I 4 

Responses 1" 5 14 

Note. N=30 
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Responses and Comments Regarding Usefulness of the Booklets 



Case Studies - 18 



2. Would you recommend tKe use of the booklets to other adoption committees? 



Responses = 



19 



Partially 

2 



3 



Comment 



Number of 
responses 



much more educated and 
careful process 

very helpful 

more critical evaluation process 

thorough and systematic 

recommend, if there is: 

commitment 

appropriate in-service 
appropriate training 
appropriate background 

good leader 

most basals came out 
with near equal pbints: 
choice needed to be 
based on things not 
covered in the booklets 

too awkward and long 

publishers should use 
them more than textbook 
adoption committees 



4 

3 
3 
2 
6 
1 

3 
2 



3 
1 
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Tables 



Sunimaiy of the Responses Regarding the Pros and Cons of Booklet Use 


rros onu vons oi DOOKici use 


Number of Responses 


Advantages oV- 




Using the Booklets 




• provides committees with 


9 


&C5Carcn*pa5eu uuonnauon 




about reading instruction 




• objective approach - "not 


7 


just, 'this looks good*" 




• systematic, comprehensive 


5 


and thorough process 




Disadvantages of 




Using Booklets 




• time-consummg 


7 


• delimitations of the 


3 


group using the booklets 




• need mterested committee 


0 


• need knowledgeable committee 


0 


Note: N^30 
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